Electronic device and computer program product

ABSTRACT

An electronic device includes a display and a control unit. The display displays a plurality of images of a subject captured in a first image-capturing region of an image sensor. The control unit controls the image sensor so as to set image-capturing conditions for the first image-capturing region to be different from image-capturing conditions for a second image-capturing region of the image sensor by using an image selected from the plurality of images displayed on the display.

This application is a continuation of U.S. patent application Ser. No.15/563,783 filed on Oct. 2, 2017, which is a National Stage Entry ofInternational Application No. PCT/UP2016/060496 filed on Mar. 30, 2016,which claims priority to Japanese Patent Application No. 2015-070439filed on Mar. 30, 2015. The entire contents of each of the abovementioned documents are incorporated by reference herein.

TECHNICAL FIELD

The present invention relates to an electronic device and a computerprogram product.

BACKGROUND ART

PTL1 discloses an image-capturing apparatus having an image sensor thatcan be able to set image-capturing conditions for each of regions in ascreen.

CITATION LIST Patent Literature

PTL1: Japanese Laid-Open Patent Publication No. 2006-49361

SUMMARY OF INVENTION Technical Problem

The prior art has a difficulty in setting image-capturing conditions foreach region.

Solution to Problem

According to the 1st aspect of the present invention, an electronicdevice comprises: an image-capturing unit that captures an image of asubject with an image sensor, the image sensor being configured to beable to set image-capturing conditions for a plurality of regions on animage-capturing surface; and a control unit that determines theimage-capturing conditions varied for each of the regions, based on asubject element detected from the image captured by the image-capturingunit.

According to the 2nd aspect of the present invention, in the electronicdevice according to the 1st aspect, it is preferred that the controlunit determines the image-capturing conditions, based on the subjectelement and a preset image-capturing mode.

According to the 3rd aspect of the present invention, in the electronicdevice according to the 1st or 2nd aspect, it is preferred that theelectronic device further comprises an image processing unit thatgenerates a candidate image by varying the image-capturing conditionsdetermined by the control unit, in at least one of the plurality ofregions.

According to the 4th aspect of the present invention, in the electronicdevice according to the 3rd aspect, it is preferred that the imageprocessing unit generates a plurality of candidate images having varyingstages of the image-capturing conditions.

According to the 5th aspect of the present invention, in the electronicdevice according to the 4th aspect, it is preferred that: theimage-capturing conditions are at least one of luminance and chroma; andthe image processing unit generates the plurality of candidate imageshaving varying stages of luminance or chroma.

According to the 6th aspect of the present invention, in the electronicdevice according to the 5th aspect, it is preferred that the imageprocessing unit generates the captured image before a change in theimage-capturing conditions for each of the regions as a reference imageand also generates the candidate image after the change in theimage-capturing conditions for each of the regions.

According to the 7th aspect of the present invention, in the electronicdevice according to the 6th aspect, it is preferred that the imageprocessing unit generates the reference image and an image having aluminance different from that of the reference image.

According to the 8th aspect of the present invention, in the electronicdevice according to the 6th or 7th aspect, it is preferred that theimage processing unit generates the reference image and an image havinga chroma different from that of the reference image.

According to the 9th aspect of the present invention, in the electronicdevice according to any one of the 3rd to 8th aspects, it is preferredthat the electronic device further comprises a display unit thatdisplays the candidate image or the candidate images.

According to the 10th aspect of the present invention, in the electronicdevice according to the 9th aspect, it is preferred that the electronicdevice further comprises a setting unit that sets the image-capturingconditions for the candidate image in the image-capturing surfacecorresponding to the candidate image, if an operation of selecting thecandidate image displayed on the display unit is performed,

According to the 11th aspect of the present invention, in the electronicdevice according to the 9th aspect, it is preferred that the electronicdevice further comprises a display control unit that displays a regionrepresenting an image created under the image-capturing conditionsvaried by the image processing unit, among the plurality of regions, ina manner different from other regions on the display unit.

According to the 12th aspect of the present invention, a computerprogram product causes a computer to execute: an image-capturing processof capturing an image of a subject with an image sensor, the imagesensor being configured to be able to set image-capturing conditions fora plurality of regions on an image-capturing surface; and a determiningprocess of determining the image-capturing conditions varied for each ofthe regions, based on a subject element detected from the image capturedby the image-capturing unit.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram illustrating a configuration of a cameraaccording to an embodiment.

FIG. 2 is a cross-sectional view of a stacked image sensor.

FIG. 3 is a view for explaining a pixel arrangement and a unit region ofan image-capturing chip.

FIG. 4 is a diagram illustrating a circuit in the unit region.

FIG. 5 is a block diagram illustrating a functional configuration of animage sensor corresponding to the circuit in FIG. 4.

FIG. 6 is a view schematically illustrating an image of a subject formedon an image sensor of a camera.

FIG. 7 is a view illustrating a setting screen for image-capturingconditions.

FIG. 8 is a view illustrating a setting screen for image-capturingconditions.

FIG. 9 is a view illustrating a display screen that displays candidateimages arranged vertically and horizontally.

FIG. 10 is a view illustrating a display screen that displays candidateimages arranged vertically and horizontally.

FIG. 11 is a view illustrating a display screen that displays candidateimages arranged vertically and horizontally.

FIG. 12 is a view illustrating a display screen that displays candidateimages arranged vertically and horizontally.

FIG. 13 is a view illustrating a display screen that displays candidateimages arranged vertically and horizontally.

FIG. 14 is a flowchart for explaining a flow of a process of settingimage-capturing conditions for each region and capturing an image.

FIG. 15 is a view illustrating a display screen according to a firstvariation.

FIG. 16 is a view illustrating a display screen according to a firstvariation.

FIG. 17 is a view illustrating a display screen according to a secondvariation.

FIG. 18 is a view illustrating a display screen according to a secondvariation.

FIG. 19 is a block diagram illustrating a configuration of animage-capturing system according to a fifth variation.

FIG. 20 is a view for explaining supply of a program to a mobile device.

DESCRIPTION OF EMBODIMENTS

Description of Camera:

FIG. 1 is a block diagram illustrating a configuration of an electronicdevice (e.g., a camera 1) according to an embodiment. In FIG. 1, thecamera 1 includes an image-capturing optical system 31, animage-capturing unit 32, an image processing unit 33, a working memory34, a control unit 35, a liquid crystal monitor 36, an operation member37, a non-volatile memory 38 , a recording unit 39, and a light-emittingdevice 40.

The image-capturing optical system 31 directs light flux from a subjectfield to the image-capturing unit 32. The image-capturing unit 32includes an image sensor 100 and a driving unit 32 a and performs aphotoelectric conversion on a subject image formed by theimage-capturing optical system 31. The image-capturing unit 32 maycapture images under the same conditions for all regions of theimage-capturing surface in the image sensor 100 or under differentconditions for different regions of the image-capturing surface in theimage sensor 100. The image-capturing unit 32 will be described later indetail. The driving unit 32 a generates a driving signal required tocause the image sensor 100 to control charge storage. An image-capturinginstruction for the image-capturing unit 32 including a charge storagetime is transmitted from the control unit 35 to the driving unit 32 a.

The image processing unit 33 cooperates with the working memory 34 toperform image processing on image data captured by the image-capturingunit 32. The image processing includes, for example, contour enhancementprocessing, gamma correction, white balance adjustment, displayluminance adjustment, and chroma adjustment. The image processing unit33 may perform image processing by applying the same parameters and thelike for all regions of the image or applying different parameters andthe like for different regions of the image, as described later.

The working memory 34 is a memory that temporarily records image databefore and after image processing and other data. The control unit 35,which is composed of a CPU or the like, controls the overall operationof the camera 1. For example, the control unit 35 performs apredetermined exposure calculation on the basis of an image signalacquired by the image-capturing unit 32 to determine exposure conditionssuch as a charge storage time (an exposure time) of the image sensor100, an aperture value of the image-capturing optical system 31, and anISO sensitivity which are required for a correct exposure. The controlunit 35 then sends an instruction to the driving unit 32 a. The controlunit 35 also determines image processing conditions which adjust chroma,contrast, sharpness, and the like in accordance with a scene capturemode set in the camera 1 and a type of a detected subject element. Thecontrol unit 35 then sends an instruction to the image processing unit33. The detection of the subject element will be described later.Further, if the setting causes the light-emitting device 40 to emitlight, the control unit 35 determines a light-emitting amount of thelight-emitting device 40 which is required for a correct exposure. Thecontrol unit 35 then sends an instruction to the light-emitting device40.

The control unit 35 includes an object detection unit 35 a, a regionpartitioning unit 35 b, a setting unit 35 c, an image-capturingcondition setting unit 35 d, an image-capturing control unit 35 e, an AFcalculation unit 35 f, and a display control unit 35 g. These units maybe embodied in software by the control unit 35 executing programs storedin the non-volatile memory 38. Alternatively, the units may be composedof ASICs or the like.

The object detection unit 35 a performs known object recognitionprocessing to detect subject elements from the image captured by theimage-capturing unit 32, such as persons (faces of persons), animals(faces of animals) such as dogs or cats, plants, vehicles such asbicycles, automobiles, or trains, buildings, stationary objects,landscape elements such as mountains or clouds, and predeterminedspecific objects.

The region partitioning unit 35 h divides (partitions) a screen capturedby the image-capturing unit 32 into a plurality of regions including thesubject elements detected as described above. The setting unit 35 eranks the plurality of regions partitioned by the region partitioningunit 35 b. A way of ranking will be described later.

The image-capturing condition setting unit 35 d sets image-capturingconditions for the plurality of regions partitioned by the regionpartitioning unit 35 b. The image-capturing conditions include theexposure conditions (e.g., charge storage time, gain, ISO sensitivity;frame rate) and the image processing conditions (e.g., white balanceadjustment parameters, gamma correction curves, display luminanceadjustment parameters, chroma adjustment parameters). It should be notedthat the same image-capturing conditions may be set for all of theplurality of regions or image-capturing conditions may be set to bevaried for the plurality of regions.

The image-capturing control unit 35 e controls the image-capturing unit32 (the image sensor 100) and the image processing unit 33 by applyingthe image-capturing conditions set by the image-capturing conditionsetting unit 35 d for each region. This allows the image-capturing unit32 to capture images under varying exposure conditions for the pluralityof regions partitioned by the region partitioning unit 35 b, and alsoallows the image processing unit 33 to perform image processing undervarying image processing conditions for the plurality of regionspartitioned by the region partitioning unit 35 b.

The AF calculation unit 35 f performs an automatic focus adjustment(autofocus: AF) calculation for focusing on a corresponding subject at apredetermined position (referred to as a focus point) in the capturedscreen Based on the AF calculation result, the AF calculation unit 35 ftransmits a driving signal for shifting a focus lens of theimage-capturing optical system 31 to a position where the focus lensfocuses on the subject. It should be noted that the AF scheme may be acontrast detection scheme or a phase detection (or phase differencedetection) scheme,

The display control unit 35 g controls display of an image to bedisplayed on a liquid crystal monitor 36. The display control unit 35 gmay display one image on the display surface of the liquid crystalmonitor 36 or may display a plurality of images arranged vertically andhorizontally on the display surface of the liquid crystal monitor 36,for example. The display control unit 35 g further allows imagesdisplayed on the display surface of the liquid crystal monitor 36 to bescrolled in response to a user operation.

The liquid crystal monitor 36 reproduces and displays images processedby the image processing unit 33 or images read out by the recording unit39. The liquid crystal monitor 36 also displays an operation menuscreen, a setting screen for setting image-capturing conditions, andother screens.

The operation member 37 includes a variety of operation members, such asa shutter release button and menu buttons. The operation member 37transmits an operation signal corresponding to each operation to thecontrol unit 35. The operation member 37 also includes a touch operationmember provided on the display surface of the liquid crystal monitor 36.

The non-volatile memory 38 records the programs to be executed by thecontrol unit 35 and the like. The recording unit 39 records image dataand the like in a recording medium composed of a memory card (not shown)or the like, in response to an instruction from the control unit 35. Therecording unit 39 also reads out the image data recorded in therecording medium, in response to an instruction from the control unit35.

The light-emitting device 40 is an auxiliary photographing light sourcefor illuminating a subject. If the setting causes the light-emittingdevice 40 to emit light, for example, the light-emitting device 40 emitslight having a light amount specified by the control unit 35, inresponse to a light-emitting instruction from the control unit 35.

<Description of Stacked Image Sensor>

A stacked image sensor 100 provided in the above-described camera 1 willbe described. International Publication WO13/164915, which waspreviously filed by the present applicants and has been published,discloses the stacked image sensor 100. FIG. 2 is a cross-sectional viewof the stacked image sensor 100. The image sensor 100 includes aback-side illumination image-capturing chip 113 that outputs pixelsignals corresponding to incident light, a signal processing chip 111that processes the pixel signals, and a memory chip 112 that records thepixel signals. The image-capturing chip 113, the signal processing chip111, and the memory chip 112 are stacked and electrically connected toone another with conductive bumps 109, which are made of Cu, forexample.

It should be noted that the incident light is incident mainly in apositive Z-axis direction which is denoted by a white arrow, asillustrated in FIG. 2. In this embodiment, a surface of theimage-capturing chip 113 on which the incident light is incident isreferred to as a back surface (an image-capturing surface). Furthermore,a direction toward the left on the paper plane orthogonal to the Z axiswill be defined as a positive X-axis direction, and a direction towardthe front side of the paper plane orthogonal to the Z axis and the Xaxis will be defined as a positive Y-axis direction, as denoted by thecoordinate axes. Some of the following figures illustrate coordinateaxes with reference to the coordinate axes in FIG. 2 to clarify theorientation of the figures.

An example of the image-capturing chip 113 is a back-side illuminationMOS image sensor. A PD layer 106 is arranged on the back surface side ofa wiring layer 108. The PD layer 106 includes a plurality of PDs(photodiodes) 104 that are two-dimensionally arranged and store chargesin accordance with incident light, and transistors 105 that are providedin a manner corresponding to the PDs 104.

On the side of the PD layer 106 on which the incident light is incident,color filters 102 are arranged with a passivation film 103 between thePD layer 106 and the color filters 102. The color filters 102 include anumber of types of filters transmitting different wavelength ranges andhave a specific arrangement in a manner corresponding to the PDs 104.The arrangement of the color filters 102 will be described later. Acolor filter 102, a PD 104, and a transistor 105 together form onepixel.

On the side of the color filter 102 on which incident light is incident,a microlens 101 is provided in a manner corresponding to each pixel. Themicrolens 101 focuses the incident light onto the corresponding PD 104.

The wiring layer 108 has a wiring line 107 that transmits the pixelsignal from the PD layer 106 to the signal processing chip 111. Thewiring line 107 may be multilayered and may also be provided withpassive elements and active elements.

A plurality of bumps 109 are disposed on a surface of the wiring layer108. The plurality of bumps 109 are aligned with a plurality of bumps109 provided on a surface of the signal processing chip 111 opposing tothe wiring layer 108. The aligned bumps 109 are then joined andelectrically connected to each other by a pressure applied on theimage-capturing chip 113 and the signal processing chip 111 or by othermeasures.

Similarly, a plurality of bumps 109 are disposed on opposing surfaces ofthe signal processing chip 111 and the memory chip 112. These bumps 109are aligned with each other. The aligned bumps 109 are then joined andelectrically connected to each other by a pressure applied on the signalprocessing chip 111 and the memory chip 112 or by other measures.

It should be noted that the bonding of the bumps 109 is not limited toCu bump bonding by solid phase diffusion. Microbump bonding by soldermelting may be employed. Additionally, only approximately one bump 109is required for each of blocks which will be described later, forexample. The size of the bump 109 may thus be larger than the pitch ofthe PD 104. In a peripheral region other than the pixel region where thepixels are arranged, bumps that are larger than the bumps 109corresponding to the pixel region may also be provided together.

The signal processing chip 111 has a TSV (through-silicon via) 110 thatconnects a circuit provided on the front surface to a circuit providedon the back surface of the signal processing chip 111. The TSV 110 ispreferably provided in the peripheral region. The TSV 110 may also beprovided in the peripheral region of the image-capturing chip 113 or inthe memory chip 112.

FIG. 3 is a view for explaining a pixel arrangement and an unit region131 of the image-capturing chip 113. Specifically, FIG. 3 illustratesthe image-capturing chip 113 as seen from the back surface(image-capturing surface) side. The pixel region has, for example, 20million or more pixels that are arranged in a matrix. In the example inFIG. 3, sixteen adjacent pixels (i.e., 4×4 pixels) form one unit region131. Grid lines in the figure illustrate how adjacent pixels are groupedto form the unit region 131. The number of pixels forming the unitregion 131 is not limited to this value. Alternatively, approximately1000 pixels may be used, such as 32×64 pixels or more or less.

As illustrated in a partial enlarged view of the pixel region, the unitregion 131 in FIG. 3 includes four (upper and lower, right and left)so-called Bayer arrangements, each consisting of four pixels: greenpixels Gb, Gr, a blue pixel B, and a red pixel R. The green pixel Gb orGr having a green filter as its color filter 102 receives light in agreen wavelength band of incident light. Similarly, the blue pixel Bhaving a blue filter as its color filter 102 receives light in a bluewavelength band, and the red pixel R having a red filter as its colorfilter 102 receives light in a red wavelength band.

In this embodiment, a plurality of blocks are defined so that each blockincludes at least one unit region 131. Each block can control pixelsincluded therein with its own control parameters. In other words,image-capturing signals indicating varying image-capturing conditionscan be acquired for a pixel group included in one block and a pixelgroup included in another block. The control parameters include, forexample, frame rate, gain, subsampling rate, the number of rows orcolumns for addition of the pixel signals, charge storage time or thenumber of charge storage events, and the number of bits (a word length)in digitization. The image sensor 100 is free to perform subsampling notonly in the row direction (the X-axis direction of the image-capturingchip 113), but also in the column direction (the Y-axis direction of theimage-capturing chip 113). The control parameters may also be parametersin the image processing after the acquisition of the image signal fromthe pixel.

FIG. 4 is a view for explaining a circuit in the unit region 131. In theexample in FIG. 4, nine adjacent pixels (i.e., 3×3 pixels) form one unitregion 131. As described above, the number of pixels included in theunit region 131 is not limited to this value. More or less pixels may beused. Symbols A to I denote two-dimensional positions in the unit region131.

Reset transistors for pixels included in the unit region 131 can beindividually turned on and off. In FIG. 4, a reset wiring line 300 forturning on and off the reset transistor of the pixel A is provided, anda reset wiring line 310 for turning on and off the reset transistor ofthe pixel B is provided separately from the reset wiring line 300.Similarly, a reset wiring line 320 for turning on and off the resettransistor of the pixel C is provided separately from the reset wiringlines 300 and 310. Other pixels D to I are also provided with their ownreset wiring lines for turning on and off their reset transistors.

Transfer transistors for pixels included in the unit region 131 can alsobe individually turned on and off. In FIG. 4, a transfer wiring line 302for turning on and off the transfer transistor of the pixel A, atransfer wiring line 312 for turning on and off the transfer transistorof the pixel B, and a transfer wiring line 322 for turning on and offthe transfer transistor of the pixel C are separately provided. Otherpixels D to I are also provided with their own transfer wiring lines forturning on and off their transfer transistors.

Selection transistors for pixels included in the unit region 131 canalso be individually turned on and off. In FIG. 4, a selection wiringline 306 for turning on and off the selection transistor of the pixel A,a selection wiring line 316 for turning on and off the selectiontransistor of the pixel B, and a selection wiring line 326 for turningon and off the selection transistor of the pixel C are separatelyprovided. Other pixels D to I are also provided with their own selectionwiring lines for turning on and off their selection transistors.

It should be noted that a power supply wiring line 304 is shared betweenthe pixels A to I included in the unit region 131. Similarly, an outputwiring line 308 is shared between the pixels A to I included in the unitregion 131. While the power supply wiring line 304 is shared between aplurality of unit regions, the output wiring line 308 is providedseparately for each unit region 131. A load current source 309 suppliesan electric current to the output wiring line 308. The load currentsource 309 may be provided in the image-capturing chip 113 or in thesignal processing chip 111.

Individually turning on and off the reset transistors and the transfertransistors of the unit region 131 allows control of charge storageparameters including a charge storage start time, a charge storage endtime, and a transfer timing for the pixels A to I included in the unitregion 131. Additionally, individually turning on and off the selectiontransistors of the unit region 131 allows output of pixel signals of thepixels A to I through the shared output wiring line 308.

In this context, a so-called rolling shutter scheme is known, in whichcharge storage is controlled in a regular order in rows and columns forpixels A to I included in the unit region 131. In the rolling shutterscheme, a row of the pixels may be selected and then a column may bedesignated, so that the pixel signals for the pixels are output in orderof “ABCDEFGHI” in the example in FIG. 4.

A configuration of the circuit composed of the unit regions 131 in thisway allows the charge storage time to be controlled for each unit region131. In other words, pixel signals can be output at different framerates for different unit regions 131. Furthermore, the charge storage(the image-capturing) is performed in unit regions 131 included in someblocks in the image-capturing chip 113, while it is disabled in unitregions 131 included in other blocks. This may result in image-capturingand output of pixel signals only in predetermined blocks of theimage-capturing chip 113. Additionally, blocks in which the chargestorage (the image-capturing) is to be performed blocks targeted for thecharge control) may be switched from one frame to another, so thatimages are captured and pixel signals are output sequentially indifferent blocks of the image-capturing chip 113.

FIG. 5 is a block diagram illustrating a functional configuration of theimage sensor 100 corresponding to the circuit illustrated in FIG. 4. Ananalog multiplexer 411 sequentially selects nine PDs 104 forming theunit region 131 to output a pixel signal for each PD 104 to the outputwiring line 308 provided in a manner corresponding to the unit region131. The multiplexer 411 is formed on the image-capturing chip 113,together with the PDs 104.

The pixel signal outputted via the multiplexer 411 is subjected tocorrelated double sampling (CDS) and analog-to-digital (A/D) conversionin the signal processing circuit 412, which is formed in the signalprocessing chip 111 to perform the CDS and A/D conversion. The A/Dconverted pixel signal is delivered to a demultiplexer 413 and thenstored in a pixel memory 414 corresponding to each pixel. Thedemultiplexer 413 and the pixel memories 414 are formed in the memorychip 112.

The arithmetic circuit 415 processes the pixel signal stored in thepixel memory 414 and delivers the processed pixel signal to the imageprocessing unit that follows the arithmetic circuit 415. The arithmeticcircuit 415 may be provided in the signal processing chip 111 or in thememory chip 112. Although FIG. 5 illustrates only the connectionconfiguration for one unit region 131, such configurations areindividually provided for unit regions 131 and operate in parallel, inpractice. However, the arithmetic circuit 415 may not be provided foreach unit region 131. For example, one arithmetic circuit 415 maysequentially reference and process values of the pixel memories 414corresponding to individual unit regions 131.

As described above, the output wiring line 308 is provided in a mannercorresponding to each unit region 131. Electrical connections betweenthe chips with the bumps 109 may be used for the output wiring lines308, which enables routing of the wiring lines without increasing theextent of the chips in the plane direction, since the image-capturingchip 113, the signal processing chip 111, and the memory chip 112 arestacked in the image sensor 100.

<Setting of Image-Capturing Conditions for each Region>

This embodiment allows setting of image-capturing conditions for each ofa plurality of blocks in the image sensor 100 (the image-capturing chip113). The control unit 35 correlates the regions partitioned by theregion partitioning unit 35 b to the blocks to capture an image underimage-capturing conditions setting for the individual regions.

A user sets image-capturing conditions for a desired region whileviewing a live view image displayed on the display surface of the liquidcrystal monitor 36, for example. The live view image refers to an imagefor monitoring that is repeatedly captured at a predetermined frame rate(e.g., 60 fps).

When the user sets (changes) image-capturing conditions for a region,the control unit 35 causes the image processing unit 33 to perform imageprocessing on the region in the live view image. The image processingperformed here is image processing for observing the effects due tochanges in the image-capturing conditions. For example, if theimage-capturing conditions are changed to increase the luminance, imageprocessing is performed for increasing the display luminance on theliquid crystal monitor 36. Furthermore, if the image-capturingconditions are changed to cause the light-emitting device 40 to emitlight, for example, image processing is performed for increasing thedisplay luminance on the liquid crystal monitor 36 for a predeterminedsubject element (for example, a person). Furthermore, if theimage-capturing conditions are changed to increase the chroma, forexample, image processing is performed for increasing the chroma for apredetermined subject element (for example, a flower) displayed on theliquid crystal monitor 36. In this way, the user can observe the effectsdue to the changes in the image-capturing conditions while viewing theprocessed live view images, before actual image-capturing. The settingof image-capturing conditions for each region will be described below indetail. It should be noted that the embodiment is not limited to themethod of processing images and displaying the processed images on theliquid crystal monitor 36 to observe the effects due to the changes inthe image-capturing conditions for the region. Alternatively, a methodmay be used which reflects the change in the image-capturing conditionsfor a region onto the image sensor corresponding to the region anddisplays a live view image under the set (changed) image-capturingconditions on the liquid crystal monitor 36.

FIG. 6 is a view schematically illustrating a subject image formed onthe image sensor 100 of the camera 1. The camera 1 photoelectricallyconverts the subject image into a live view image, before animage-capturing instruction is provided.

The control unit 35 first sets the same image-capturing conditions forall regions of the image-capturing chip 113 (i.e., the entireimage-capturing surface). The exposure conditions of the image-capturingconditions are determined based on exposure conditions calculated so asto achieve a correct exposure in accordance with a photometric value ofa subject luminance, or based on exposure conditions manually set by theuser. The image processing conditions of the image-capturing conditionsare determined to be image processing conditions prepared in advance toprovide a standard image quality. The image-capturing conditionsdetermined in this way are hereinafter referred to as referenceconditions. An image obtained with the use of the reference conditionsis referred to as a reference image.

An example of determining the reference conditions will be described.The control unit 35 selects one of a “program auto” mode, a “shutterspeed priority auto” mode, an “aperture priority auto” mode, and a“manual” mode, in accordance with an operation signal from an exposuremode changeover switch constituting the operation member 37. The controlunit 35 then performs a predetermined exposure calculation according tothe selected exposure mode to calculate the exposure conditions (chargestorage time, gain, ISO sensitivity, frame rate, and the like) describedabove.

Specifically, in the case of the “program auto” mode, the control unit35 determines an aperture value, a shutter speed (a charge storagetime), a gain, and the like so that the average luminance in the screenis appropriate, for example. In the case of the “shutter speed priorityauto” mode, the control unit 35 uses the shutter speed (the chargestorage time) set by the user to determine the aperture value, the gain,and the like so that the average luminance in the screen is appropriate,for example. In the case of the “aperture priority auto” mode, thecontrol unit 35 uses the aperture value set by the user to determine theshutter speed (the charge storage time), the gain, and the like so thatthe average luminance in the screen is appropriate, for example. In thecase of the “manual” mode, the control unit 35 calculates a deviationfrom the correct exposure based on the aperture value and the shutterspeed (the charge storage time) set by the user.

In FIG. 6, an image including a person 61 a, an automobile 62 a, a bag63 a, a mountain 64 a, and clouds 65 a and 66 a is formed on theimage-capturing surface of the image-capturing chip 113. The person 61 aholds the bag 63 a in both hands. Behind and right of the person 61 a,the automobile 62 a is parked.

<Region Partitioning>

Based on the live view image, the control unit 35 partitions an imagecaptured as a live view image into a plurality of regions in thefollowing way. First, subject elements are detected from the live viewimage by the object detection unit 35 a. Any of known subjectrecognition technologies is employed for the detection of the subjectelements. In the example in FIG. 6, the object detection unit 35 adetects the person 61 a, the automobile 62 a, the bag 63 a, the mountain64 a, the cloud 65 a, and the cloud 66 a as the subject elements.

Next, the region partitioning unit 35 b partitions the image captured asthe live view image into regions including the subject elements, basedon the above-described detecting measure. In this example, for the sakeof explanation, a region including the person 61 a will be defined as afirst region 61, a region including the automobile 62 a as a secondregion 62, a region including the bag 63 a as a third region 63, aregion including the mountain 64 a as a fourth region 64, a regionincluding the cloud 65 a as a fifth region 65, and a region includingthe cloud 66 a as a sixth region 66.

The setting unit 35 c ranks the plurality of regions partitioned by theregion. partitioning unit 35 b. If the setting unit 35 c detects thefollowing regions (1) to (4) among the regions partitioned by the regionpartitioning unit 35 b, the setting unit 35 c sets these regions asregions having higher priorities for changing image-capturing conditionsthan those of other regions partitioned by the region partitioning unit35 b.

(1) A Region in which a Specific Subject Corresponding to a SceneCapture Mode is Detected

A specific subject depends on a preset scene capture mode of the camera1. For example, if the preset scene capture mode of the camera 1 is aportrait mode, the setting unit 35 c sets the first region 61 includingthe person 61 a as a region having a higher priority for changingimage-capturing conditions than those of the second region 62 includingthe automobile 62 a, the third region 63 including the bag 63 a, thefourth region 64 including the mountain 64 a, the fifth region 65including the cloud 65 a, and the sixth region including the cloud 66 a.This is based on the idea that image-capturing conditions for the firstregion 61 including the person 61 a are likely to be set (changed) inthe portrait mode.

For example, if the preset scene capture mode of the camera 1 is aclose-up mode and a flower has been detected by the object detectionunit 35 a as a subject element, the setting unit 35 c sets a regionincluding the flower as a region having a higher priority for changingimage-capturing conditions than those of other regions. This is based onthe idea that image-capturing conditions for the region including theflower are likely to be set (changed) in the close-up mode.

For example, if the preset scene capture mode of the camera 1 is alandscape mode and a mountain has been detected by the object detectionunit 35 a as a subject element, the setting unit 35 c sets a regionincluding the mountain as a region having a higher priority for changingimage-capturing conditions than those of other regions. This is based onthe idea that image-capturing conditions for the region including themountain are likely to be set (changed) in the landscape mode.

For example, if the preset scene capture mode of the camera 1 is a beachmode and the ocean has been detected by the object detection unit 35 aas a subject element, the setting unit 35 c sets a region including theocean as a region having a higher priority for changing image-capturingconditions than those of other regions. This is based on the idea thatimage-capturing conditions for the region including the ocean are likelyto be set (changed) in the beach mode.

For example, if the preset scene capture mode of the camera 1 is asunset mode and red sky has been detected by the object detection unit35 a as a subject element, the setting unit 35 c sets a region includingthe red sky as a region having a higher priority for changingimage-capturing conditions than those of other regions. This is based onthe idea that image-capturing conditions for the region including thered sky are likely to be set (changed) in the sunset mode.

For example, if the preset scene capture mode of the camera 1 is acuisine mode and food served on a dish has been detected by the objectdetection unit 35 a as a subject element, the setting unit 35 c sets aregion including the dish and the food as a region having a higherpriority for changing image-capturing conditions than those of otherregions. This is based on the idea that image-capturing conditions forthe region including the food served on a dish are likely to be set(changed) in the cuisine mode.

The scene capture modes of the camera 1 described above may be set bythe user operating the operation member 37 or by the control unit 37 onthe basis of the subject elements detected from the screen of the liveview image.

(2) a Region including a Focused Subject Element

If the AF operation for focusing on the subject corresponding to thefocus point as described above is performed, the setting unit 35 c setsa region including the focused subject element (i.e., the subjectelement corresponding to the focus point) as a region having a higherpriority for changing image-capturing conditions than those of regionsincluding defocused subject elements. If no subject element is in focus,a region including a subject element having the smallest focus deviationamount (i.e., a subject clement having the smallest distance from itsposition to a focus position) may be determined as a region having ahigher priority for changing image-capturing conditions.

(3) a Region including a Subject Element having the Lowest Luminance orthe Highest Luminance

Among the plurality of subject elements detected by the object detectionunit 35 a, the setting unit 35 c sets a region including the darkest orbrightest subject element as a region having a higher priority forchanging image-capturing conditions than those of other regions. This isbased on the idea that image-capturing conditions for an excessivelydark subject element such as a blocked-up shadow (clipped blacks) or anexcessively bright subject element such as a blown-out highlight(clipped whites) are likely to be set (changed).

(4) a Region including a Subject Element having a High Proportion of aCertain Color Component

Among the plurality of subject elements detected by the object detectionunit 35 a, the setting unit 35 c sets a region including a subjectelement having a higher proportion of a color component of the greenpixel Gb or Gr, the blue pixel B, or the red pixel R described abovethan those of other color components as a region having a higherpriority for changing image-capturing conditions than those of otherregions. This is based on the idea that image-capturing conditions forthe region including a subject element having a color such as blue ofsky, blue of ocean, green of mountain, or red of sunset are likely to beset (changed).

(5) a Region including a Subject Element Closest to the Camera 1

The setting unit 35 c determines a region including a subject elementclosest to the camera 1 as a region having a higher priority forchanging image-capturing conditions than that of a region including asubject element further from the camera 1. For example, the control unit35 acquires information concerning distances between the camera 1 andthe partitioned subject elements and determines a region including asubject element closest to the camera 1. If no distance information isacquired, the control unit 35 may determine a region including a subjectelement occupying the largest proportion of the screen as a subjectelement closest to the camera 1.

If the setting unit 35 c detects the following regions (6) to (10) amongthe regions partitioned by the region partitioning unit 35 b, thesetting unit 35 c determines these regions as regions having lower ranksfor changing image-capturing conditions than those of theabove-described regions (1) to (5).

(6) a Region including a Subject Element having the Smallest FocusDeviation Amount

If the AF operation for focusing on the subject corresponding to thefocus point as described above is performed, the setting unit 35 c setsa region including a subject element having the smallest focus deviationamount among regions except for a region including the focused subjectelement among the subject elements detected by the object detection unit35 a, as a region having a higher priority for changing image-capturingconditions than those of other regions. In general, the sharpness of thecontour of a subject element increases as the focus deviation amountdecreases. It can thus be said that a subject element having the contourwith a higher sharpness has a smaller focus deviation amount. Thesetting unit 35 c sets a region including a subject element having thecontour with a higher sharpness as a region having a higher priority forchanging image-capturing conditions than that of a region including asubject element having the contour with a lower sharpness.

(FIRST EXAMPLE)

In FIG. 6, for example, it is assumed that the AF calculation unitperforms an AF operation on the first region 61 so that the person 61 ais in focus. The setting unit 35 c sets the third region 63 including asubject element having the smallest focus deviation amount (i.e., thebag 63 a which is closest to the position of the person 61 in focus)among the automobile 62 a, the bag 63 a, the mountain 64 a, the cloud 65a, and the cloud 66 a, as a region having a second priority for changingimage-capturing conditions, next to the first region 61 including theperson 61 a. This is based on the idea that image-capturing conditionsfor the third region 63 including the bag 63 a are likely to be set(changed), next to the first region 61 including the person 61 a.

(SECOND EXAMPLE)

In FIG. 6, for example, it is assumed that the AF calculation unitfocuses on a point between the person 61 a and the automobile 62 a. Thesetting unit 35 c sets the second region 62 including a subject elementhaving the smallest focus deviation amount (i.e., the automobile 62 awhich is closest to the position in focus) among the automobile 62 a,the bag 63 a, the mountain 64 a, the cloud 65 a, and the cloud 66 a, asa region having a second priority for changing image-capturingconditions, next to the first region 61 including the is person 61 a.This is based on the idea that image-capturing conditions for the secondregion 62 including the automobile 62 a are likely to be set (changed),next to the first region 61 including the person 61 a.

(7) a Region including a Subject Element having a Small Difference inDistance

The setting unit 35 c ranks the subject elements on the basis ofdifferences in distances between the camera 1 and the subject elements.In FIG. 6, for example, it is assumed that an AF operation is performedon the first region 61 so that the person 61 a is in focus. In thiscase, the setting unit 35 c sets a region including a subject elementhaving a distance from the camera 1 closer to a distance between thecamera 1 and the person 61 a (i.e., a smaller difference between thedistances), among the automobile 62 a, the bag 63 a, the mountain 64 a,the cloud 65 a, and the cloud 66 a, as a region having a higher priorityfor changing image-capturing conditions.

(8) a Region including a Subject Element having a Large Difference inLuminance

In FIG. 6, for example, it is assumed that an AF operation is performedon the first region 61 so that the person 61 a is in focus. The settingunit 35 c sets a region including a subject element having the largestdifference between its luminance and the luminance of the person 61 a,among the automobile 62 a, the bag 63 a, the mountain 64 a, the cloud 65a, and the cloud 66 a, as a region having a second priority for changingimage-capturing conditions, next to the first region 61 including theperson 61 a. For example, if the mountain 64 a is the subject elementhaving the largest difference between its luminance and the luminance ofthe person 61 a, the setting unit 35 c sets the fourth region includingthe mountain 64 a as a region having a second priority for changingimage-capturing conditions, next to the first region 61 including theperson 61 a. This is based on the idea that image-capturing conditionsfor a region including a subject element having a large differencebetween its luminance and the luminance of the person 61 a are likely tobe set (changed).

(9) a Region including a Large Subject Element

If the magnitude of the difference between the focus deviation amountsof the regions including the subject elements is insufficient and themagnitude of the difference between the luminances of the regions isalso insufficient, the setting unit 35 c assigns a higher rank forchanging image-capturing conditions to a region including a subjectelement that is larger than other subject elements, that is, a regionthat occupies a larger area in the screen,

(10) a region including a subject element close to the center of thescreen

If the magnitude of the difference between the focus deviation amountsof the regions including the subject elements is insufficient and themagnitude of the difference between the luminances of the regions isalso insufficient, the setting unit 35 c assigns a higher rank to aregion including a subject element closer to the center of the screen.

In this embodiment, one of the above-described regions (6) to (10) mayhe selected in advance by the user operating the operation member 37.Some of the regions (6) to (10) may also be combined.

In accordance with the procedures described above, the setting unit 35 cranks the second region 63 to the sixth region 66. For example, thesecond region 62 including the automobile 62 a, which is a large subjectelement, is defined as a second-ranked region, the third region 63including the bag 63 a as a third-ranked region, the fourth region 64including the mountain 64 a as a fourth-ranked region, the fifth region65 including the cloud 65 a as a fifth-ranked region, and the sixthregion 66 including the cloud 66 a as a sixth-ranked region.

The setting unit 35 c regards regions having no ranks even after theprocedures for the conditions (6) to (10) described above, as regionshaving the same rank.

<Setting of Image-capturing Conditions for Region>

Once the region partitioning unit 35 b partitions the screen into theplurality of regions, the control unit 35 displays a setting screen asillustrated in FIG. 7 on the liquid crystal monitor 36. In FIG. 7, alive view image 60 a is displayed and also icons 71 and 72 aredisplayed, superimposed on the live view image 60 a. The live view image60 a is a reference image obtained with the use of the above-mentionedreference conditions.

The icon 71 is an operation icon for selecting “luminance” as an exampleof setting items of the image-capturing conditions. The icon 72 is anoperation icon for selecting “chroma” as an example of setting items ofthe image-capturing conditions. Other operation icons for selectingsetting items of the image-capturing conditions may be added to thoseillustrated in FIG. 7, as appropriate. Furthermore, the setting items ofthe image-capturing conditions may be selected and determined by aphotographer. Alternatively, they may be judged and determined by thecontrol unit 35 of the camera 1 on the basis of a detected subjectimage.

In FIG. 7, a region having a highlighted (thick, bright, differentlycolored, dashed-lined, blinking, etc.) contour among the first to sixthregions indicates a region targeted for setting (changing)image-capturing conditions. In the example in FIG. 7, the live viewimage 60 a including the first region 61 having a highlighted contour isdisplayed. This means that the first region 61 is a target region forsetting (changing) image-capturing conditions. The highlight of thecontour of the first region 61 clearly shows the user the target regionfor setting (changing) image-capturing conditions. In the setting screenin FIG. 7, the first region targeted for setting (changing)image-capturing conditions is a region having the first rank assigned bythe setting unit 35 c.

For example, when a user taps the icon 71 in a touch-operated camera 1,the control unit 35 selects luminance as a setting item of theimage-capturing conditions to be set (changed) for the highlightedregion (the first region 61). It is assumed that the camera 1 istouch-operated in the following description; however, setting items ofthe image-capturing conditions may be selected by operation on buttonsconstituting the operation member 37 or the like.

<Changing in Luminance>

In the setting screen illustrated in FIG. 7, the control unit 35 whichhas selected luminance as the setting item of the image-capturingconditions determines image-capturing conditions corresponding to thefirst region 61 targeted for setting (changing) image-capturingconditions in the live view image so that the luminance of the firstregion 61 becomes higher (or lower) than the luminance of the referenceimage. For regions that are not targeted for setting (changing)image-capturing conditions (regions other than the first region 61), thecontrol unit 35 maintains the preset image-capturing conditions to keepthe luminance of the reference image.

It should be noted that in a region that is not targeted for setting(changing) image-capturing conditions, image-capturing conditions may hechanged near a boundary between the region and the first region 61 sothat the discontinuity of the image-capturing conditions near theboundary is blurred, in consideration of balance of the entire image,

In increasing the luminance of the first region 61, the image-capturingcondition setting unit 35 d determines image-capturing conditions underwhich the luminance is increased, by making the charge storage timelonger than the charge storage time of the above-described referenceconditions or making the gain higher than the gain of theabove-described reference conditions, among the image-capturingconditions of the first region 61, for example.

In reducing the luminance of the first region 61, the image-capturingcondition setting unit 35 d determines image-capturing conditions underwhich the luminance is reduced, by making the charge storage timeshorter than the charge storage time of the above-described referenceconditions or making the gain lower than the gain of the above-describedreference conditions, among the image-capturing conditions of the firstregion 61, for example.

In determining image-capturing conditions under which the luminance isincreased or reduced, the image-capturing condition setting unit 35 ddetermines image-capturing conditions in multiple stages (for example,in eight stages) in which the luminance gradually varies from theluminance obtained under the reference conditions. However, the upperlimit of the luminance which is increased is set to a value at which ahigh luminance region in the first region 61 of the live view image isnot saturated (not blown out in white (no clipped whites)). The lowerlimit of the luminance which is reduced is set to a value at which a lowluminance region in the first region 61 of the live view image is notexcessively dark (not shadowed in black (no clipped blacks)).

The image-capturing condition setting unit 35 d determinesimage-capturing conditions in multiple stages to increase and reduce theluminance of the first region 61 as described above and setsimage-capturing conditions in multiple stages determined in terms ofluminance in the image processing unit 33. The setting in the imageprocessing unit 33 is intended to obtain candidate images in multiplestages as described later, by image processing on the live view image.

<Change in Chroma>

In the setting screen illustrated in FIG. 7, the control unit 35 whichhas selected chromes as the setting item of the image-capturingconditions determines image-capturing conditions corresponding to thefirst region 61 targeted for setting (changing) image-capturingconditions in the live view image so that the chroma of the first region61 becomes higher (or lower) than the chroma of the reference image. Forregions that are not targeted for setting (changing) image-capturingconditions (regions other than the first region 61), the control unit 35maintains the preset image-capturing conditions to keep the chroma ofthe reference image.

It should be noted that in a region that is not targeted for setting(changing) image-capturing conditions, image-capturing conditions may bechanged near a boundary between the region and the first region 61 sothat the discontinuity of the image-capturing conditions near theboundary is blurred, in consideration of balance of the entire image.

In increasing the chroma of the first region 61, the image-capturingcondition setting unit 35 d determines image-capturing conditions underwhich vividness of a specific color is enhanced, for example, byincreasing a value of a signal read out from the green pixel Gb or Gr,the blue pixel B, or the red pixel. R relative to values of signals ofother color components, with respect to the image-capturing conditionsof the first region 61.

In reducing the chroma of the first region 61, the image-capturingcondition setting unit 35 d determines image-capturing conditions underwhich vividness of a specific color is restricted, for example, byrelatively reducing a value of a signal of a color component that ismore prominent than other components, among signals read from the greenpixels Gb, Gr, the blue pixel B, and the red pixel R, with respect tothe image-capturing conditions of the first region 61.

In determining image-capturing conditions under which the chroma isincreased or reduced, the image-capturing condition setting unit 35 ddetermines image-capturing conditions in multiple stages (for example,in eight stages) in which the chroma gradually varies from the chromaobtained under the reference conditions. However, the upper limit of thechroma which is increased is set to a value at which a signal having ahigh chroma (a prominent color component) in the first region 61 of thelive view image is not saturated. Additionally, the lower limit of thechroma which is reduced is set to a value at which the first region 61of the live view image still has a certain degree of vividness of color,not an achromatic color.

The image-capturing condition setting unit 35 d determinesimage-capturing conditions in multiple stages to increase and reduce thechroma of the first region 61 as described above and setsimage-capturing conditions in multiple stages determined for the chromain the image processing unit 33. The setting in the image processingunit 33 is intended to obtain candidate images in multiple stages asdescribed later, by image processing on the live view image.

For example, if the preset scene capture mode of the camera 1 is aportrait mode, the image-capturing condition setting unit 35 ddetermines image-capturing conditions corresponding to the first region61 including the person 61 a so as to reduce the chroma of the person.Additionally, the image-capturing condition setting unit 35 d determinesimage-capturing conditions corresponding to the fourth region 64including the mountain 64 a in the background so as to increase thechroma of the mountain (make values of signals read out from the greenpixels Gr and Gb higher than values of signals of other colorcomponents, for example). This is based on the idea that vividness ofthe background is likely to be enhanced to highlight the person 61 a inthe portrait mode.

For example, if the preset scene capture mode of the camera 1 is acuisine mode and food served on a dish has been detected by the objectdetection unit 35 a as a subject element, the image-capturing conditionsetting unit 35 d determines the image-capturing conditions so as toincrease the chroma for a region including the dish and the food.

For example, if the preset scene capture mode of the camera 1 is anautumn leaves mode and red autumn leaves have been detected by theobject detection unit 35 a as a subject element, the image-capturingcondition setting unit 35 d determines the image-capturing conditions soas to increase the chroma (for example, increase a value of a signalread out from the red pixel R relative to values of signals of othercolor components) for a region including the red autumn leaves. The samealso applies to the case where the preset image-capturing scene mode ofthe camera 1 is the sunset mode.

For example, if the preset scene capture mode of the camera 1 is a beachmode and the ocean has been detected by the object detection unit 35 aas a subject element, the image-capturing condition setting unit 35 ddetermines the image-capturing conditions so as to increase the chroma(for example, increase a value of a signal read out from the blue pixelB relative to values of signals of other color components) for a regionincluding the ocean or sky.

<Other Live View Images>

FIG. 8 is a view illustrating a setting screen of the liquid crystalmonitor 36 that displays a live view image 60 b different from the liveview image 60 a. For example, if the preset scene capture mode of thecamera 1 is a close-up mode and a red flower has been detected by theobject detection unit 35 a as a subject element, the setting unit 35 cassigns a first rank to a region including the red flower. This resultsin the first region 61 b having a highlighted contour as the targetregion for setting (changing) image-capturing conditions. As describedabove, this is based on the idea that image-capturing conditions for theregion including the flower is more likely to be set (changed) thanthose of other regions in the close-up mode. The icons 71 and 72 in FIG.8 are the same as those in the setting screen illustrated in FIG. 7;thus, the description thereof will be omitted.

In the setting screen illustrated in FIG. 8, the control unit 35 whichhas selected chroma as the setting item of the image-capturingconditions determines image-capturing conditions for the first region 61b targeted for setting (changing) image-capturing conditions in the liveview image so as to increase the chroma (for example, increase a valueof a signal read out from the red pixel R relative to values of signalsof other color components). The image-capturing condition setting unit35 d determines image-capturing conditions under which vividness of thecolor of the red flower is enhanced, by increasing a value of a signalread out from the red pixel R relative to values of signals of othercolor components.

As illustrated above, the image-capturing condition setting unit 35 ddetermines the image-capturing conditions under which the chroma ischanged, by changing a value of a signal of a color component that ismore prominent than other components, among signals read from the greenpixels Gb, Gr, the blue pixel B, and the red pixel R, for a color of asubject element in each of the regions partitioned by the regionpartitioning unit 35 b.

<Display of Candidate Images>

If the image-capturing control unit 35 e sets the image-capturingconditions in multiple stages in terms of luminance as described above,the image processing unit 33 creates a plurality of images (eight imagesin the case of the eight stages described above) having varying stagesof image luminance in the first region 61 of the reference imageobtained with the use of the above-described reference conditions. Inthis embodiment, a plurality of images created in this way are referredto as candidate images. The plurality of candidate images created by theimage processing unit 33 are temporarily recorded in the working memory34.

If the image-capturing control unit 35 e sets the image-capturingconditions in multiple stages in terms of chroma as described above, theimage processing unit 33 creates a plurality of images (eight images inthe case of the eight stages described above) having varying stages ofimage chroma in the first region 61 b of the above-described referenceimage. The plurality of images are also referred to as candidate images.The plurality of candidate images created by the image processing unit33 are temporarily recorded in the working memory 34.

If the above-described plurality of candidate images are recorded in theworking memory 34, the display control unit 35 g displays the candidateimages arranged vertically and horizontally on the display surface ofthe liquid crystal monitor 36 as illustrated in FIG. 9. FIGS. 9 to 12are views each illustrating a screen of the liquid crystal monitor 36that displays candidate images arranged vertically and horizontally.

If the candidate images having varying luminance in multiple stages asdescribed above are recorded in the working memory 34, the displaycontrol unit 35 g displays these candidate images for luminance arrangedvertically and horizontally on the display surface of the liquid crystalmonitor 36. Furthermore, if the candidate images having varying chromain multiple stages as described above are recorded in the working memory34, the display control unit 35 g displays these candidate images forchroma arranged vertically and horizontally on the display surface ofthe liquid crystal monitor 36.

In FIG. 9, four candidate images (candidate images 60-1 to 60-4) of theeight candidate images are displayed. The candidate image 60-2 has aluminance (or a chroma) that is one stage higher than that of thecandidate image 60-1. The candidate image 60-3 has a luminance (or achroma) that is one stage higher than that of the candidate image 60-2.The candidate image 60-4 has a luminance (or a chroma) that is one stagehigher than that of the candidate image 60-3.

A left icon 73 is displayed on the left side of the candidate image 60-1and a right icon 74 is displayed on the right side of the candidateimage 60-4. For example, when a user taps the right icon 74 with afinger 80 on the display screen in FIG. 9, the display control unit 35 gdisplays four candidate images (candidate images 60-2 to 60-5) of theeight candidate images, as illustrated in FIG. 10. In FIG. 10, thecandidate image 60-1 is no longer displayed, which has been displayed inFIG. 9, and the candidate image 60-5 is newly displayed, which has notbeen displayed in FIG. 9. The candidate image 60-5 has a luminance (or achroma) that is one stage higher than that of the candidate image 60-4.

Although not illustrated, when the user taps the left icon 73 with thefinger 80 on the display screen in FIG. 10, for example, the displaycontrol unit 35 g displays four of the eight candidate images (candidateimages 60-1 to 60-4) as illustrated in FIG. 9. In other words, thecandidate image 60-5 is no longer displayed, which has been displayed inFIG. 10, and the candidate image 60-1 is newly displayed, which has notbeen displayed in FIG. 10.

FIG. 11 is a view illustrating a screen of the liquid crystal monitor 36that displays four candidate images (candidate images 60-3 to 60-6) ofthe eight candidate images. The candidate image 60-6 has a luminancethat is one stage higher than that of the candidate image 60-5.

For example, when the user performs a vertical slide operation in thedirection of the arrow in the display screen with the finger 80 on thedisplay screen in FIG. 11, the display control unit 35 g displays fourcandidate images (candidate images 60-1 to 60-4) of the eight candidateimages. In FIG. 12, the candidate images 60-4 and 60-5 are no longerdisplayed, which have been displayed in FIG. 11, and the candidateimages 60-1 and 60-2 are newly displayed, which have not been displayedin FIG. 11.

In this way, the user can view the plurality of candidate images.Furthermore, by the tap operation on the left icon 73 or the right icon74 or the slide operation with the finger 80, the user can display andview candidate images that have not been displayed on the liquid crystalmonitor 36.

FIG. 13 is a view illustrating a screen of the liquid crystal monitor 36that displays candidate images, which have varying chromas in multiplestages, arranged vertically and horizontally. In FIG. 13, four candidateimages (candidate images 160-1 to 160-4) of the eight candidate imagesare displayed. The candidate image 160-2 has a chroma that is one stagehigher than that of the candidate image 160-1. The candidate image 160-3has a chroma that is one stage higher than that of the candidate image60-2. The candidate image 160-4 has a chroma that is one stage higherthan that of the candidate image 160-3. A left icon 73 and a right icon74 are the same as those illustrated in FIG. 9 or FIG. 10; thus, thedescription thereof will be omitted.

<Selecting Operation>

The user selects one of a plurality of candidate images. For example,when the user double-taps a position at which one of a plurality ofcandidate images is displayed on the screen illustrated in FIGS. 9 to 12with the finger 80, the control unit 35 determines image-capturingconditions to be applied to the first region 61 in response to the nextimage-capturing instruction in the following way and again displays thesetting screen as illustrated in FIG. 7 on the liquid crystal monitor36.

In other words, the control unit 35 (the image-capturing control unit 35e) sets the image-capturing conditions applied to the first area 61 ofthe double-tapped candidate image in the image-capturing unit 32 or theimage processing unit 33. The setting in the image-capturing unit 32 isintended to achieve the change in the luminance by changing the exposureconditions of the image sensor 100 in the next image-capturing event.The setting in the image processing unit 33 is intended to achieve thechange in the chroma by changing the image-capturing conditions of theimage processing unit 33 in the next image-capturing event.

Specifically, when one of the plurality of candidate images forluminance is double-tapped, the image-capturing condition setting unit35 d determines exposure conditions that achieve the luminancecorresponding to the double-tapped candidate image as image-capturingconditions (exposure conditions) applied for the region 61. Theimage-capturing control unit 35 e then sets the conditions in theimage-capturing unit 32.

When one of the plurality of candidate images for chroma isdouble-tapped on the screen illustrated in FIG. 13, the image-capturingcondition setting unit 35 d determines image processing conditions thatachieve the chroma corresponding to the double-tapped candidate image asimage-capturing conditions (image processing conditions) applied for theregion 161. The image-capturing control unit 35 e then sets theconditions in the image processing unit 33.

The user may perform an operation of selecting one of the plurality ofcandidate images in terms of luminance and then selecting one of theplurality of candidate images in terms of chroma. Furthermore, the usermay perform an operation of selecting one of the plurality of candidateimages in terms of chroma and then selecting one of the plurality ofcandidate images in terms of luminance.

Furthermore, the user may perform an operation of selecting one of theplurality of candidate images in terms of luminance or chroma, also forregions other than the first region 61, i.e., regions having second andsubsequent ranks assigned by the setting unit 35 c. When the settingscreen as illustrated in FIG. 7 is displayed on the liquid crystalmonitor 36 and the user taps a region other than the first region 61with a finger, for example, the control unit 35 highlights the tappedregion, instead of the first region 61. The image-capturing conditionsetting unit 35 d sets the highlighted region as a target region forsetting (changing) image-capturing conditions. Subsequent settingoperations are the same as those in the case of the first area 61described above.

Without the user tapping a region other than the first area 61, thecontrol unit 35 may sequentially set regions having second andsubsequent ranks assigned by the setting unit 35 c as regions targetedfor setting (changing) image-capturing conditions.

Although this embodiment describes an example of highlighting thecontour of the region targeted for setting (changing) image-capturingconditions (the first region 61 in the above example), it may bepossible to display the entire target region with a higher contrast orto blink the entire target region, instead of highlighting its contour.The target region may also be surrounded by a frame. The framesurrounding the target region may be displayed as a double frame or asingle frame, and the display style of the surrounding frame such asline type may be changed as appropriate. The control unit 35 may alsodisplay an indicator for indicating a region targeted for settingimage-capturing conditions, such as an arrow, in the vicinity of thetarget region. The control unit 35 may also display regions other thanthe target region for setting (changing) image-capturing conditions witha lower brightness or with a lower contrast.

When a shutter release button (not shown) constituting the operationmember 37 or a display icon for instructing the start of image-capturingis activated after the image-capturing conditions for the region havebeen set as described above, the control unit 35 captures an image underthe image-capturing conditions set for each of the partitioned regions,generates processed image data, and records the image data in arecording medium composed of a memory card (not shown) or the like,

<Description of Flowchart>

FIG. 14 is a flowchart for explaining a flow of a process of settingimage-capturing conditions for each region and capturing an image. Whena main switch of the camera 1 is turned on, the control unit 35activates a program of executing the process illustrated in FIG. 14. Instep S10, the control unit 35 starts bye view display on the liquidcrystal monitor 36 and proceeds to step S20.

Specifically, the control unit 35 instructs the image-capturing unit 32to start to acquire live view images and sequentially display theacquired live view images on the liquid crystal monitor 36. As describedabove, at that point in time, the same image-capturing conditions areset for all regions of the image-capturing chip 113, i.e., the entirescreen. If the setting causes an AF operation to be performed during thelive view display, the control unit 35 (the AF calculation unit 351)controls the AF operation of focusing on a subject element correspondingto a predetermined focus point. If the setting does not allow an AFoperation to be performed during the live view display, the control unit35 (the AF calculation unit 35 f) performs the AF operation later at apoint in time when the AF operation is instructed.

In step S20, the control unit 35 (the object detection unit 35 a)detects subject elements from the live view image and proceeds to stepS30. In step S30, the control unit 35 (the region partitioning unit 35h) partitions the screen of the live view image into regions includingthe subject elements, and proceeds to step S40.

In step S40, the control unit 35 determines the above-describedreference conditions on the basis of the setting state of the camera 1or the state of the subject. In other words, the control unit 35 setsthe same image-capturing conditions for all regions of the screen andproceeds to step S50.

In step S50, the control unit 35 uses the reference conditions toacquire a live view image (a reference image) and proceeds to step S60.In step S60, the control unit 35 selects a region targeted for setting(changing) image-capturing conditions among the regions partitioned bythe region partitioning unit 35 b. For example, the control unit 35selects regions in order of ranks assigned by the setting unit 35 c,beginning with the first-ranked region.

In step S70, the control unit 35 determines whether an operation fordisplaying the candidate image has been performed. If the user taps theicon 71 or 72 in FIG. 7 (or FIG. 8) as described above, the control unit35 makes a positive determination in step S70 and proceeds to step S80.If the user taps neither the icon 71 nor the icon 72, the control unit35 makes a negative determination in step S70 and proceeds to step S120.

In step S80, the control unit 35 determines image-capturing conditionsto be set (changed). In other words, the control unit 35 determines asetting item corresponding to the icon 71 or 72 tapped by the user andproceeds to step S90.

In step S90, the control unit 35 (the image-capturing condition settingunit 35 d) acquires a plurality of candidate images for the setting itemdetermined in step S80 and proceeds to step S100. In step S100, thecontrol unit 35 displays the plurality of candidate images on thedisplay surface of the liquid crystal monitor 36 and proceeds to stepS110.

In step S110, when the user performs the above-described selectingoperation (for example, the double tap operation), the control unit 35determines image-capturing conditions corresponding to the double-tappedcandidate image, for the region targeted for setting (changing)image-capturing conditions. The control unit 35 then sets the conditionsin image-capturing unit 32 or the image processing unit 33 and proceedsto step S120.

It should be noted that the display change of the liquid crystal monitor36 and the setting of the image-capturing conditions in response to theuser operation in step S110 have been described above.

In step S120, the control unit 35 determines a presence or absence of animage-capturing instruction. If a shutter release button (not shown)constituting the operation member 37 or a display icon for instructingimage-capturing is operated, the control unit 35 makes a positivedetermination in step S120 and proceeds to step S130. In the case of theabsence of the image-capturing instruction, the control unit 35 makes anegative determination in step S120 and returns to step S70.

In step S130, the control unit 35 performs predeterminedactual-image-capturing processing. In other words, the image-capturingcontrol unit 35 e controls the image-capturing unit 32 to capture animage under the image-capturing conditions set for each of the regions,and the image processing unit 33 performs predetermined image processingon the captured and acquired image data. Then, the recording unit 39records the image data in a recording medium (not shown).

In step S140, the control unit 35 determines whether an end operationhas been performed. If the end operation has been performed, the controlunit 35 makes a positive determination in step S140 and ends the processin FIG. 14. If the end operation has not been performed, the controlunit 35 makes a negative determination in step S140 and returns to stepS20. Returning to step S20, the control unit 35 repeats theabove-described process steps.

According to the above-described embodiment, the following operationsadvantages can be obtained.

(1) The camera 1 includes the image capturing unit 32 that captures animage of a subject with the image sensor 100 configured to be able toset image-capturing conditions for the plurality of regions on theimage-capturing surface; and the control unit 35 that determinesparameters in changing image-capturing conditions for each region, basedon the subject element detected from the captured live view image. Sincethe camera 1 automatically determines the parameters for changingimage-capturing conditions for each region, the user can easily setimage-capturing conditions for each region.

(2) The control unit 35 determines the parameters on the basis of thesubject element and the preset image-capturing mode. This allowssuitable parameters to be automatically determined depending on thetypes of the subject elements (e.g., person, mountain, flower, and soon) and the image-capturing modes (e.g., portrait mode, landscape mode,and so on). The user can thus easily set image-capturing conditions foreach region.

(3) The camera 1 includes the image processing unit 33 that generatescandidate images under image-capturing conditions varied with parametersdetermined by the control unit 35, in at least one of a plurality ofregions in the captured live view image. This allows the user to observethe effects due to the changes in the image-capturing conditions for theregion while viewing candidate images which are the processed live viewimages, before actual image-capturing.

(4) The control unit 35 determines a plurality of parameters, and theimage processing unit 33 uses the plurality of parameters determined bythe control unit 35, which are different from one another, to generate aplurality of candidate images having varying stages of image-capturingconditions. This allows the user to compare the effects due to thechanges in the image-capturing conditions, while viewing the pluralityof candidate images having varying stages of image-capturing conditions.

(5) The image-capturing condition may be luminance or chroma, and theimage processing unit 33 generates a plurality of candidate imageshaving varying stages of luminance or chroma. This allows the user tocompare the effects due to the changes in the luminance (or the chroma),while viewing the plurality of candidate images having varying stages ofluminance (or chroma).

(6) The image processing unit 33 generates the captured live view imageas the reference image before the change in the image-capturingconditions, and also generates candidate images after the change in theimage-capturing conditions. This allows the user to observe the effectsdue to the changes in the image-capturing conditions for the region,comparing with images before and after the changes in theimage-capturing conditions.

(7) The image processing unit 33 generates the reference image, an imagehaving a higher luminance than that of the reference image, and/or animage having a lower luminance than that of the reference image. Thisallows the user to observe the effects due to the changes in theluminance for the region, comparing with images before and after thechanges in the luminance.

(8) The image processing unit 33 generates the reference image, an imagehaving a higher chroma than that of the reference image, and/or an imagehaving a lower chroma than that of the reference image. This allows theuser to observe the effects due to the changes in the chroma for theregion, comparing with images before and after the changes in thechroma.

(9) Since the camera 1 includes the liquid crystal monitor 36 thatdisplays the image generated by the image processing unit 33, the usercan visually compare the effects due to the change in theimage-capturing conditions for the region.

(10) The camera 1 includes the control unit 35. If an operation ofselecting the candidate image displayed on the liquid crystal monitor 36is performed, the control unit 35 sets image-capturing conditionscorresponding to parameters used for the generation of the candidateimage, for a region of the image-capturing surface of theimage-capturing unit 32 corresponding to the region for which thecandidate image are generated. The user can thus easily setimage-capturing conditions for each region.

(11) The camera 1 includes the display control unit 35 g that displays aregion representing an image created under image-capturing conditionsvaried by the image processing unit 33, among the plurality of regions,in a manner different from other regions on the liquid crystal monitor36. This can clearly show the user the region targeted for setting(changing).

The following variations also fall within the scope of the presentinvention, and one or more of the variations may be combined with theabove-described embodiment.

(First Variation)

The above description illustrates the example in which the displaycontrol unit 35g displays the plurality of candidate images arrangedvertically and horizontally on the display surface of the liquid crystalmonitor 36, as illustrated in FIGS. 9 and 13. Alternatively, thereference image may be displayed on the display surface of the liquidcrystal monitor 36. In this case, only an image of a region targeted forsetting (changing) image-capturing conditions (the first region 61 inthe above example) in the reference image may be replaced with an imageof a corresponding region in a certain candidate image.

FIGS. 15 and 16 are views illustrating display screens according to afirst variation. In the first variation, if the plurality of candidateimages described above are stored in the working memory 34, the displaycontrol unit 35 g displays the reference image (the reference image60-1) based on the reference conditions on the display surface of theliquid crystal monitor 36 as illustrated in FIG. 15. At this time, theimage in the first area 61 is the reference image 61-1.

This variation is the same as the above embodiment in that the contourof the first area 61 targeted for setting (changing) image-capturingconditions is highlighted.

In FIG. 15, a left icon 73 is displayed on the left side of the firstregion 61 and a right icon 74 is displayed on the right side of thefirst region 61. For example, when the user taps the right icon 74 withthe finger 80 on the display screen in FIG. 15, the display control unit35 g displays a composite image in which only the image in the firstregion 61 is replaced with the candidate image 61-2, as illustrated inFIG. 16. The reference image 60-1 remains to be displayed in backgroundregions other than the first region 61.

The candidate image 61-2 has a luminance (or a chroma) that is one stagehigher than that of the candidate image 61-1. In this way, the displaycontrol unit 35 g reads out an necessary candidate image 60-2 among theeight candidate images temporarily stored in the working memory 34, inaccordance with the tap operation on the right icon 74. The displaycontrol unit 35 g then extracts only the candidate image 61-2 in thefirst region 61 of the read out image 60-2 and uses the image 61-2 forthe composite display illustrated in FIG. 16.

Although not illustrated, when the user taps the left icon 73 with thefinger 80 on the display screen in FIG. 16, for example, the displaycontrol unit 35 g displays a composite image in which the image in thefirst region 61 is replaced with the reference image 61-1, asillustrated in FIG. 15. The reference image 60-1 remains to be displayedin background regions other than the first region 61.

According to the first variation, the user can view candidate images forthe first region 61 targeted for setting (changing) image-capturingconditions. Furthermore, by the tap operation on the left icon 73 or theright icon 74, the user can display and view other candidate images inthe first region 61.

In the first variation, when a candidate image is displayed and the userdouble-taps any position in the screen with the finger 80, the controlunit 35 (the image-capturing condition setting unit 35 d) determinesimage-capturing conditions applied for a candidate image 61-n (where nis a natural number of 1 to 8) that is displayed in the first region 61at that point in time, as image-capturing conditions to be applied forthe first region 61 in response to the next image-capturing instruction.Then, the control unit 35 again displays the setting screen asillustrated in FIG. 7 on the liquid crystal monitor 36.

This variation is the same as the above embodiment in that the user mayperform an operation of selecting one of the plurality of candidateimages in terms of luminance and then selecting one of the plurality ofcandidate images in terms of chroma and in that the user may perform anoperation of selecting one of the plurality of candidate images in termsof chroma and then selecting one of the plurality of candidate images interms of luminance.

Additionally, this variation is the same as the above embodiment in thatthe user may set (change) image-capturing conditions in terms ofluminance or chroma, also for regions other than the first region 61,i.e., regions having second and subsequent ranks assigned by the settingunit 35 c.

(Second Variation)

FIGS. 17 and 18 are views illustrating display screens according to asecond variation. In the second variation, if the plurality of candidateimages described above are stored in the working memory 34, the displaycontrol unit 35 g displays the reference image (the reference image60-1) based on the reference conditions on the left side of the displaysurface of the liquid crystal monitor 36 and also displays the candidateimage 60-2 on the right side of the display surface, as illustrated inFIG. 17.

This variation is the same as the above embodiment in that the contourof the first area 61 targeted for setting (changing) the image-capturingconditions is highlighted.

In FIG. 17, an upper icon 75 is displayed above the right candidateimage 60-2 and a lower icon 76 is displayed below the candidate image60-2. For example, when the user taps the lower icon 76 with the finger80 on the display screen in FIG. 17, the display control unit 35 gdisplays a candidate image 60-3, in place of the right candidate image60-2, as illustrated in FIG. 18. The left reference image 60-1 remainsto be displayed.

The candidate image 60-3 has a luminance (or a chroma) that is one stagehigher than that of the candidate image 60-2. In this way, the displaycontrol unit 35 g reads out the necessary candidate image 60-3 among theeight candidate images temporarily stored in the working memory 34, inaccordance with the tap operation on the down icon 76, and uses thecandidate image 60-3 for display as illustrated in FIG. 18.

Although not illustrated, when the user taps the up icon 75 with thefinger 80 on the display screen in FIG. 18, for example, the displaycontrol unit 35 g displays the candidate image 60-2 in place of thecandidate image 60-3 displayed on the right side of the screen, asillustrated in FIG. 17. The reference image 60-1 remains to be displayedon the left side of the screen.

According to the second variation, the user can view the candidateimages in conjunction with the reference image. Furthermore, by the tapoperation on the up icon 75 or the down icon 76, the user can displayand view other candidate images that have not been displayed on theliquid crystal monitor 36.

In the second variation, when a candidate image is displayed and theuser double-taps any position in the screen with the finger 80, thecontrol unit 35 (the image-capturing condition setting unit 35 d)determines image-capturing conditions applied for a candidate image 60-n(where n is a natural number of 1 to 8) that is displayed on the rightside of the display surface at that point in time, as image-capturingconditions to be applied for the first region 61 in response to the nextimage-capturing instruction. Then, the control unit 35 again displaysthe setting screen as illustrated in FIG. 7 on the liquid crystalmonitor 36.

This variation is the same as the above embodiment in that the user mayperform an operation of selecting one of the plurality of candidateimages in terms of luminance and then selecting one of the plurality ofcandidate images in terms of chroma and in that the user may perform anoperation of selecting one of the plurality of candidate images in termsof chroma and then selecting one of the plurality of candidate images interms of luminance.

Additionally, this variation is the same as the above embodiment in thatthe user may set (change) image-capturing conditions in terms ofluminance or chroma, also for regions other than the first region 61,i.e., regions having second and subsequent ranks assigned by the settingunit 35 c.

(Third Variation)

The above embodiment illustrates, as one example of the method ofdetermining reference conditions, a method of selecting one of the“program auto” mode, the “shutter speed priority auto” mode, the“aperture priority auto” mode, and the “manual” mode is selected so thata predetermined exposure calculation is performed in accordance with theselected exposure mode to determine a correct exposure; and determiningthe image-capturing conditions prepared for a standard image quality,wherein the determined exposure conditions and the image processingconditions are determined as reference conditions. Alternatively, thereference conditions may be determined as follows.

<Example of Determining Reference Conditions in Terms of Luminance>

The third variation changes the way of determining a correct exposuredepending on the scene capture mode setting of the camera 1 and thesubject element detected by the object detection unit 35 a, and sets theconditions determined here as reference conditions (exposureconditions). For example, if the preset scene capture mode of the camera1 is a portrait mode and the object detection unit 35 a has detected aperson as a subject element, the control unit 35 determines exposureconditions for a region including the person so that the luminance ofthe person is appropriate, and sets the exposure conditions as referenceconditions.

For example, if the preset scene capture mode of the camera 1 is a nightview portrait mode and the object detection unit 35 a has detected aperson as a subject element, the control unit 35 determines exposureconditions for a region including the person so that the luminance ofthe person becomes higher, and further determines correct exposureconditions for the region including night view in the background inconsideration of the luminance of the night view. The control unit 35then sets the exposure conditions as reference conditions. Furthermore,when the light-emitting device 40 is caused to emit light, a correctexposure is determined to balance luminances of both the person and thebackground and accordingly a required light emission amount of thelight-emitting device 40 is calculated.

For example, if the preset scene capture mode of the camera 1 is alandscape mode and the photographing distance is farther than apredetermined distance (approximately infinite), the control unit 35determines exposure conditions so that a luminance of a subject element(for example, a mountain) is appropriate for a region including themountain on the basis of a proportion of the color components (the greenpixels Gb, Gr, the blue pixel B, and the red pixel R) and the luminanceof the subject element. The control unit 35 then sets the exposureconditions as reference conditions.

<Example of Determining Reference Conditions in Terms of Chroma>

In the third variation, image processing conditions prepared in additionto conditions for a standard image quality are set as referenceconditions (exposure conditions), depending on the scene capture modesetting of the camera 1 and the subject element detected by the objectdetection unit 35 a.

If a region partitioned by the region partitioning unit 35 b has asignal of a color component that is more prominent than other colorcomponents among the signals read from the green pixels Gb, Gr, the bluepixel B, and the red pixel R, the control unit 35 determines conditionsso that a raw image without any processing (a flat image) is obtainedfor the region. The control unit 35 then sets the conditions determinedin this way as reference conditions.

For example, if the preset scene capture mode of the camera 1 is aclose-up mode and a red flower has been detected by the object detectionunit 35 a as a subject element, the setting unit 35 c determinesconditions for the region including the red flower so that the exposureis reduced to reduce saturation of the red component. The setting unit35 c then sets the conditions determined in this way as referenceconditions.

(Fourth Variation)

Although the above description illustrates the camera 1 as an example,mobile devices including an advanced mobile phone 250 such as asmartphone having a camera function or a tablet terminal may beemployed.

(Fifth Variation)

The above embodiment illustrates the camera 1 having the image-capturingunit 32 and the control unit 35 integrated into a single electronicdevice, as one example. An image-capturing system IB may instead beconfigured in which the image capturing unit 32 and the control unit 35are separately provided and the control unit 35 controls theimage-capturing unit 32 via communication means, for example. An examplewill be described below in which a controller 1002 including the controlunit 35 controls an image-capturing apparatus 1001 including theimage-capturing unit 32.

FIG. 19 is a block diagram illustrating a configuration of theimage-capturing system 1B according to a fifth variation. In FIG. 19,the image-capturing system 1B is composed of the image-capturingapparatus 1001 and the display device 1002. The image-capturingapparatus 1001 includes a first communication unit 1003 in addition tothe image-capturing optical system 31 and the image-capturing unit 32described in the above embodiment. The display device 1002 includes asecond communication unit 1004 in addition to the image processing unit33, the working memory 34, the control unit 35, the liquid crystalmonitor 36, the operation member 37, the non-volatile memory 38, therecording unit 39, and the light-emitting device 40 as described in theabove embodiment.

The first communication unit 1003 and the second communication unit 1004can bidirectionally communicate data by well-known wirelesscommunication technology, optical communication technology, or the like.The first communication unit 1003 and the second communication unit 1004may also bidirectionally communicate data by wired connection betweenthe image-capturing apparatus 1001 and the display device 1002 with awire cable.

In the image-capturing system 1B, the control unit 35 performs datacommunication via the second communication unit 1004 and the firstcommunication unit 1003 to control the image-capturing unit 32. Forexample, predetermined control data is transmitted and received betweenthe image-capturing apparatus 1001 and the display device 1002, so thatthe display device 1002 partitions a screen into a plurality of regions,ranks the partitioned regions, sets different image-capturing conditionsfor different partitioned regions, reads out an image-capturing signalcaptured in each region, and so on, on the basis of the image asdescribed above.

According to the fifth variation, a live view image acquired in theimage-capturing apparatus 1001 and transmitted to the display device1002 is displayed on the liquid crystal monitor 36 of the display device1002. The user can thus remotely operate the image-capturing apparatus1001 via the display device 1002 remote from the image-capturingapparatus 1001. The display device 1002 may include an advanced mobilephone 250 such as a smartphone. The image-capturing apparatus 1001 mayinclude an electronic device including the above-described stacked imagesensor. In the above-described example, the control unit 35 of thedisplay device 1002 includes the object detection unit 35 a, the regionpartitioning unit 35 b, the setting unit 35 c, the image-capturingcondition setting unit 35 d, the image-capturing control unit 35 e, theAF calculation unit 35 f, and the display control unit 35 g.Alternatively, the image-capturing apparatus 1001 may include parts ofthe object detection unit 35 a, the region partitioning unit 35 b, thesetting unit 35 c, the image-capturing condition setting unit 35 d, theimage-capturing control unit 35 e, the AF calculation unit 35 f, and thedisplay control unit 35 g.

(Sixth Variation)

As illustrated in FIG. 20, for example, programs may be supplied from apersonal computer 205 storing the programs to a mobile device such asthe camera 1, the advanced mobile phone 250, or a tablet terminal asdescribed above, via infrared communication or near field communication.

The personal computer 205 may be supplied with the programs by arecording medium 204 such as a CD-ROM storing the programs, which isinserted in the personal computer 205. Alternatively, the programs maybe loaded into the personal computer 205 via a communication line 201such as a network. In the case of using the communication line 201, theprograms are stored in a storage device 203 of a server 202 connected tothe communication line or other storage devices.

The programs may also be directly transmitted to the mobile device viaan access point (not shown) of a wireless LAN connected to thecommunication line 201. Alternatively, a recording medium 204B such as amemory card storing the programs may be inserted into the mobile device.Thus, the programs may be supplied in various forms of computer programproducts, such as products supplied via a recording medium or acommunication line.

Although various embodiments and variations have been described above,the present invention is not limited to these embodiments andvariations. Other aspects contemplated within the technical idea of thepresent invention are also encompassed within the scope of the presentinvention.

The disclosure of the following priority application is incorporatedherein by reference:

Japanese Patent Application No. 2015-70439 (filed Mar. 30, 2015)

REFERENCE SIGNS LIST

-   1 . . . camera-   1B . . . image-capturing system-   32 . . . image-capturing unit-   35 . . . control unit-   35 a . . . object detection unit-   35 b . . . region partitioning unit-   35 c . . . setting unit-   35 d . . . image-capturing condition setting unit-   35 e . . . image-capturing control unit-   35 g . . . display control unit-   36 . . . liquid crystal monitor-   40 . . . light-emitting device-   100 . . . image sensor-   1001 . . . image-capturing apparatus-   1002 . . . display device

1. An electronic device, comprising: a display that displays a pluralityof images of a subject captured in a first image-capturing region of animage sensor; and a control unit that controls the image sensor so as toset image-capturing conditions for the first image-capturing region tobe different from image-capturing conditions for a secondimage-capturing region of the image sensor by using an image selectedfrom the plurality of images displayed on the display.
 2. The electronicdevice according to claim 1, wherein: the control unit determines theimage-capturing conditions for the first image-capturing region, basedon the subject captured in the first image-capturing region and animage-capturing mode set in the image sensor.
 3. The electronic deviceaccording to claim 1, further comprising: an image processing unit thatgenerates a candidate image by varying the image-capturing conditionsfor the first image-capturing region determined by the control unit. 4.The electronic device according to claim 3, wherein: the imageprocessing unit generates a plurality of candidate images having varyingstages of the image-capturing conditions for the first image-capturingregion.
 5. The electronic device according to claim 3, wherein: theimage-capturing conditions are at least one of luminance and chroma; andthe image processing unit generates the plurality of candidate imageshaving varying stages of the luminance or the chroma.
 6. The electronicdevice according to claim 3, wherein: the image processing unitgenerates a captured image before a change in the image-capturingconditions for the first image-capturing region as a reference image andalso generates the candidate image after the change in theimage-capturing conditions for the first image-capturing region.
 7. Theelectronic device according to claim 6, wherein: the image processingunit generates the reference image and an image having a luminancedifferent from a luminance of the reference image.
 8. The electronicdevice according to claim 6, wherein: the image processing unitgenerates the reference image and an image having a chroma differentfrom a chroma of the reference image.
 9. The electronic device accordingto claims 1, wherein: the first image-capturing region of the imagesensor performs a photoelectric conversion that converts light into anelectric charge.
 10. The electronic device according to claim 9, furthercomprising: a plurality of photoelectric conversion units that performthe photoelectric conversion are arranged along a first direction and asecond direction which intersects the first direction in the firstimage-capturing region of the image sensor.